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(57) Abstract: A window shaping function 
is described which has an integral over the 
window shaping function of zero. Compared 
with conventional window shaping functions, 
this window shaping function improves the 
robustness of the watermark signal for a given 
quality of host signal. Methods and apparatus 
suitable for utilizing this window shaping 
function within a watermarking scheme are 
described. 
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Window shaping functions for watermarking of multimedia signals 



The present invention relates to window shaping functions, and the use of such 



functions in apparatus and methods for encoding and decoding information in multimedia 
signals, such as audio, video or data signals. 



additional data along with the multimedia signal. For instance, watermarking techniques can 
be used to embed copyright and copy control information into audio signals. 

The main requirement of a watermarking scheme is that it is not observable 
(i.e. in the case of an audio signal, it is inaudible) whilst being robust to attacks to remove the 

10 watermark from the signal (e.g. removing the watermark will damage the signal). It will be 
appreciated that the robustness of a watermark will normally be a trade off against the quality 
of the signal in which the watermark is embedded. For instance, if a watermark is strongly 
embedded into an audio signal (and is thus difficult to remove) then it is likely that the 
quality of the audio signal will be reduced. 

15 Various types of audio watermarking schemes have been proposed, each with 

its own advantages and disadvantages. For instance, one type of audio watermarking scheme 
is to use temporal correlation techniques to embed the desired data (e.g. copyright 
information) into the audio signal. This technique is effectively an echo-hiding algorithm, in 
which the strength of echo is determined by solving a quadratic equation. The quadratic 

20 equation is generated by auto-correlation values at two positions: one at delay equal to r, and 
one at delay equal to 0. At the detector, the watermark is extracted by determining the ratio of 
the auto correlation function at the two delay positions. 



5 



Watermarking of multimedia signals is a technique for the transmission of 



WO 00/00969 describes an alternative technique for embedding or encoding 



25 



auxiliary signals (such as copyright information) into a multimedia host or cover signal. A 
replica of the cover signal, or a portion of the cover signal in a particular domain (time, 
frequency or space), is generated according to a stego key, which specifies modification 
values to the parameters of the cover signal. The replica signal is then modified by an 
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auxiliary signal corresponding to the information to be embedded, and inserted back into the 
cover signal so as to form the stego signal. 

At the decoder, in order to extract the original auxiliary data, a replica of the 
stego signal is generated in the same manner as the replica of the original cover signal, and 
5 requires the use of the same stego key. The resulting replica is then correlated with the 
received stego signal so as to extract the auxiliary signal. 

In such watermarking schemes the additional data to be embedded within the 
multimedia signal typically takes the form of a sequence of values. This sequence of values is 
then converted into a slowly varying narrow-band signal by applying a window shaping 
10 function to each value. To date, only bell shaped window shaping functions such as raised 
cosine functions (e.g. the Hanning window function shown in Fig. 1) have been utilized. 

It is an object of the present invention to provide an alternative window 
shaping function that allows improved performance over prior art window shaping functions. 

15 In a first aspect, the present invention provides a method of generating a 

watermark signal for embedding in a multimedia host signal, the method comprising the steps 
of: taking a first sequence of values; applying a window shaping function to said sequence of 
values so as to form a smoothly varying signal suitable for embedding in the host signal; 
wherein the integral over the window shaping function is zero. 

20 Preferably, said window shaping function has an anti-symmetric temporal 

behavior. 

Preferably, said window shaping function has a bi-phase behavior. 
Preferably, the bi-phase window comprises at least two Hanning windows of 
opposite polarities. 

25 Preferably, the frequency spectrum of the smoothly varying signal has a DC 

component less than a component of any non-DC peak within the frequency spectrum. 

Preferably, each value of the first sequence is represented by a pulse train of 
width T s so as to form a rectangular wave signal, the window shaping function also being of 
width T s . 

30 Preferably, said first sequence of values is convolved with the window shaping 

function so as to form said smoothly varying signal. 

Preferably, the method further comprises the step of embedding said smoothly 
varying signal into the host signal. 
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In a further aspect, the present invention provides an apparatus arranged to 
generate a watermark signal suitable for embedding in a host multimedia signal, the 
apparatus comprising: 

a) a signal generator arranged to generate a watermark signal by taking a first 
5 sequence of values; and 

b) processing means arranged to apply a window shaping function to said 
sequence of values so as to form a smoothly varying signal suitable for embedding in a host 
signal; wherein the integral over the window shaping function is zero. 

Preferably, the apparatus further comprises a watermark embedding apparatus 
10 that embeds said smoothly varying signal into the host signal. 

In another aspect, the present invention provides a multimedia signal 
comprising a watermark, wherein the original multimedia signal has been watermarked by a 
smoothly varying signal formed by applying a window shaping function to a sequence of 
values, the integral over the window shaping function being zero. 
1 5 Preferably, the temporal envelope of the original signal has been modified by 

the watermark. 

In a further aspect, the present invention provides a method of detecting a 
watermark signal embedded in a multimedia signal, the method comprising the steps of: 

receiving a multimedia signal that may potentially be watermarked by a 
20 watermark signal modifying the host multimedia signal; 

extracting an estimate of the watermark from said received signal by assuming 
that the watermark comprises a sequence of values to which a window shaping function has 
been applied, the integral over the window shaping function being zero; and 

processing the estimate of the watermark with a referenced version of the 
25 watermark so as to determine whether the received signal is watermarked. 

Preferably, the method further comprises the step of applying a window 
shaping function to said received signal, the integral over the window shaping function being 
zero. 

Preferably, the watermark signal has a payload, and the method further 
30 comprises the step of determining the payload of the watermark. 

In another aspect, the present invention provides a watermark detector 
apparatus arranged to detect whether a watermark signal is embedded within a multimedia 
signal, the watermark detector comprising: 
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a receiver arranged to receive a multimedia signal that may potentially be 
watermarked by a watermark signal modifying the host multimedia signal; 

an extractor arranged to extract an estimate of the watermark from said 
received signal by assuming that the watermark comprises a sequence of values to which a 
5 window shaping function has been applied, the integral over the window shaping function 
being zero; and 

a processor arranged to process the estimate of the watermark with a 
referenced version of the watermark so as to determine whether the received signal is 
watermarked. 

10 Preferably, the apparatus further comprises a unit arranged to apply a window 

shaping function to the said received signal, wherein the integral over the window shaping 
function is zero. 

For a better understanding of the invention, and to show how embodiments of 
15 the same may be carried into effect, reference will now be made, by way of example, to the 
accompanying diagrammatic drawings in which: 

Figure 1 illustrates a Harming window shaping function, as utilized in the prior 

art; 

Figure 2 illustrates a bi-phase window shaping function according to a 
20 preferred embodiment of the present invention, in which the shapes of the two lobes are 
Harming window functions; 

Figure 3 illustrates frequency spectra for a sequence w d i[k]={l, 1,-1, 1,-1,-1} 
conditioned with respectively a Harming window shaping function and a bi-phase window 
shaping function; 

25 Figure 4 illustrates a sequence Wj formed by conditioning the sequence w d i 

with the bi-phase window shaping function shown in Fig. 2, and a running integral of Wj (f 
wO; 

Figure 5 illustrates a sequence Wj formed by conditioning the sequence w<ji 
with the Harming window shaping function, and a running integral of Wj (J Wj); 
30 Figure 6 is a diagram illustrating a watermark embedding apparatus in 

accordance with an embodiment of the present invention; 

Figure 7 shows a signal portion extraction filter H used in one preferred 

embodiment; 
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Figures 8a and 8b show respectively the typical amplitude and phase responses 
of the filter H shown in Fig. 7 as functions of frequency; 

Figure 9 shows the payload embedding and watermark conditioning stage; 

Figure 10 is a diagram illustrating the details of one possible implementation 
5 of the watermark conditioning apparatus H c of Fig. 9, including charts of the associated 
signals at each stage; 

Figure 1 1 is a diagram illustrating a watermark detector in accordance with an 
embodiment of the present invention; 

Figure 12 diagrammatically shows the whitening filter H w of Fig. 1 1, for use in 
10 conjunction with a bi-phase window shaping function; 

Figure 13 shows a typical shape of the correlation function output from the 
correlator of the watermark detector shown in Fig. 1 1 ; and 

Figure 14 illustrates a further window shaping function according to an 
alternative embodiment of the present invention. 

15 

Fig. 2 shows a window shaping function as a function of time according to a 
preferred embodiment of the present invention. The integral over the window shaping 
function is zero i.e. the total positive area of the function is equal to the total negative area 
(such that the average area is zero). The window shaping function is a bi-phase function with 
20 anti-symmetric temporal behavior, where each lobe of the window function is a Hanning 
window function. 

Use of this window shaping function within watermarking schemes has been 
shown to offer improved performance compared with the use of the Hanning window 
shaping function shown in Fig. 1. 

25 Fig. 3 illustrates the frequency spectra corresponding to a watermark sequence 

(Wdi[k]={l, 1,-1, 1,-1,-1 }) conditioned with respectively a Hanning and a bi-phase window 
shaping function. As can be seen, the frequency spectrum for the Hanning window 
conditioned watermark sequence has a maximum at frequency f=0, whilst the frequency 
spectrum for the bi-phase shaped watermark sequence has a minimum at f=0 i.e. it has very 

30 little DC component. 

In many instances, useful information is contained in the non-DC component 
of the watermark only. Consequently, for the same added watermark energy, a watermark 
conditioned with the bi-phase window will carry more useful information than one 
conditioned by the Hanning window shaping function. As a result, the bi-phase window 
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offers superior audibility performance for the same robustness, or conversely, it allows a 
better robustness for the same audibility quality. 

Fig. 4 illustrates a normalized integral (shown as a dotted line) for the 
sequence w d i conditioned with the bi-phase window shaping function shown in Fig. 2. 
5 Conversely, Fig. 5 shows a normalized integral for the same sequence conditioned with the 
Hanning window shaping function. It can be seen that the maximum value of the normalized 
integral is lower for the sequence conditioned by the bi-phase window function as compared 
to that for the sequence conditioned by the Hanning window function. 

Use of this window shaping function will now be described in conjunction 
10 with a watermarking scheme. However, it will of course be appreciated that the application of 
this window shaping function is not restricted to the below scheme, but could be applied to 
other watermarking techniques, particularly time domain watermarking techniques. It can 
also be used to carry secret keys (e.g. cryptographic keys) that can be used for the re- 
generation of reference random sequences at the detector side, allowing the possibility of 
1 5 embedding different random sequences in different host signals. 

Fig. 6 shows a block diagram of the apparatus required to perform the digital 
signal processing for embedding a multi-bit payload watermark w c into a host signal x in 
accordance with a preferred embodiment to the present invention. 

A host signal x is provided at an input 12 of the apparatus. The host signal x is 
20 passed in the direction of output 1 4 via the adder 22. However, a replica of the host signal x 
(input 8) is split off in the direction of the multiplier 18, for carrying the watermark 
information. 

The watermark signal w c is obtained from the payload embedder and 
watermark conditioning apparatus 6, and is derived from the watermark random sequence w s , 

25 which is input to the payload embedder and watermark conditioning apparatus. The 

multiplier 18 is utilized to calculate the product of the watermark signal w c and the replica 
audio signal x. The resulting product, w<jc is then passed via a gain controller 24 to the adder 
22. The gain controller 24 is used to amplify or attenuate the signal by a gain factor a. 

The gain factor a controls the trade off between the audibility and the 

30 robustness of the watermark. It may be a constant, or variable in at least one of time, 
frequency and space. The apparatus in Fig. 6 shows that, when a is variable, it can be 
automatically adapted via a signal analyzing unit 26 based upon the properties of the host 
signal x. Preferably, the gain a is automatically adapted, so as to minimize the impact on the 
signal quality, according to a properly chosen perceptibility cost- function, such as a psycho- 



10 
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acoustic model of the human auditory system (HAS). Such a model is, for instance, described 
in the paper by E.Zwicker, "Audio Engineering and Psychoacoustics: Matching signals to the 
final receiver, the Human Auditory System", Journal of the Audio Engineering Society, Vol. 
39, pp. Vol.115-126, March 1991. 

In the following, an audio watermark is utilized, by way of example only, to 
describe this embodiment of the present invention. 

The resulting watermark audio signal y is then obtained at the output 14 of the 
embedding apparatus 10 by adding an appropriately scaled version of the product of w c and x 
to the host signal: 

y[n] = x[n] + aw c [n]x[n] . (1) 



Preferably, the watermark w c is chosen such that when multiplied with*, it 
predominantly modifies the short time envelope of x 

Fig. 7 shows one preferred embodiment in which the input 8 to the multiplier 
18 in Fig. 6 is obtained by filtering the replica of the host signal x using a filter H in the 
1 5 filtering unit 1 5. If the filter output is denoted by x b , then according to this preferred 
embodiment, the watermark signal is generated by adding the product of x b and the 
watermark w c to the host signal x. 

Let x b be defined such that x b = x - x b , and y b be defined such that 

y = y b + x b , then the watermarked signal y can be written as 

y[n] = (1 + w c [n])x b [n] + x b [n] . (2) 

20 

and the envelope modulated portion^ of the watermarked signal y is given as 

y b W = (l + w c [n])x b [n) (3) 

Preferably, as shown in Fig. 8, the filter H is a linear phase band-pass filter 
characterized by its lower cut off frequency f L and upper cut off frequency fa As can be seen 

25 in Fig. 8b, the filter H has a linear phase response with respect to frequency / within the pass 
band (BW). Thus, when H is a band-pass filter, x b and x b are the in-band and out-of-band 
components of the host signal respectively. For optimum performance, it is preferable that 
the signals x b and x b are in phase. This is achieved by appropriately compensating for the 
phase distortion produced by filter H. In the case of a linear phase filter, the phase distortion 

30 is a simple delay. 
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In Fig. 9, the details of the payload embedder and watermark conditioning unit 
6 is shown. In this unit the watermark seed signal w s is converted into a multi-bit watermark 
signal w c . 

Firstly a finite length, preferably zero mean and uniformly distributed random 
5 sequence w s is generated using a random number generator with an initial seed S. As will be 
appreciated later, it is preferable that this initial seed S is known to both the embedder and the 
detector, such that a copy of the watermark signal can be generated at the detector for 
comparison purposes. This results in the sequence of length L w 

€[-U]. for k=0,l,2 t .... Lyrl (4) 
Then the sequence ws is circularly shifted by the amounts dj and d 2 using the 
1 0 circularly shifting units 30 to obtain the random sequences w<ii and w d2 respectively. It will be 
appreciated that these two sequences (wai and wji) are effectively a first sequence and a 
second sequence, with the second sequence being circularly shifted with respect to the first. 
Each sequence w di9 i = 1,2, is subsequently multiplied with a respective sign bit r i9 in the 
multiplying unit 40, where r* = +1 or — 1, the respective values of ri and T2 remaining constant, 
1 5 and only changing when the payload of the watermark is changed. Each sequence is then 
converted into a slowly varying narrow-band signal w, of length L W T S by the watermark 
conditioning circuit 20 shown in Fig. 9. Finally, the slowly varying narrow-band signals wj 
and w 2 are added with a relative delay T r (where T r <TJ to give the multi-bit payload 
watermark signal w c . This is achieved by first delaying the signal w 2 by the amount T r using 
20 delaying unit 45 and subsequently by adding it to wj with the adding unit 50. 

Fig. 10 shows one possible implementation of the watermark conditioning 
apparatus 20 used in the payload embedder and watermark conditioning apparatus 6 in more 
detail. The watermark random sequence w s is input to the conditioning apparatus 20. 

For convenience, the modification of only one of the sequences w,/, is shown 
25 in Fig. 10, but it will be appreciated that each of the sequences is modified in a similar 
manner, with the results being added to obtain the watermark signal w c . 

As shown in Fig. 10, each watermark signal sequence w^ffc], i=J,2 is applied 
to the input of a sample repeater 180. Chart 181 illustrates one of the possible sequences w di 
as a sequence of values of random numbers between +1 and -1, with the sequence being of 
30 length L w . The sample repeater repeats each value within the watermark random sequence 7^ 
times, so as to generate a pulse train signal of rectangular shape. T s is referred to as the 
watermark symbol period and represents the span of the watermark symbol in the audio 
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signal. Chart 183 shows the results of the signal illustrated in chart 181 once it has passed 
through the sample repeater 180. 

The window shaping function s[n], which is a bi-phase function as shown in 
Fig. 2, is then applied to convert the rectangular pulse signals derived from w rfy and vt></2 into 
5 slowly varying signals wjfnj and w 2 fnj respectively. The window shaping function is of 
width T s . 

The generated signals wjfnj and w 2 [n] are then added up with a relative delay 
T r (where T r <Ts). to give the multi-bit payload watermark signal w c fnj i.e. 
w c [n]= w x [n\ + w 2 \n-T r ] (5) 

10 The value of T r is chosen such that the zero crossings of w/ match the 

maximum amplitude points of w 2 and vice- versa. Thus, for this bi-phase window shaping 
function T r =T s /4. For other window shaping functions, other values of T r are possible. 

As will be appreciated by the below description, during detection the 
correlation of w c [n] will generate two correlation peaks that are separated by pL (as can be 

15 seen in Fig. 13). The value pL is part of the payload, and is defined as 



pL =| d 2 -d x |mo< 



(6) 



In addition to pL, extra information can be encoded by changing the relative signs of the 
embedded watermarks. In the detector, this is seen as a relative sign r 5ign between the 
correlation peaks. It will be seen that r sign can take four possible values, and may be defined 
20 as: 

■8»- 2 '*V»+ 3 «feW} P> 



where pj=siga(cL/) and p2 z=z sign(cL^) are respectively estimates of the sign bits r t (input 80) 
and r2 (input 90) of Fig. 9, and cLj and cL 2 are the values of the correlation peak 
corresponding to w^i and w<t 2 respectively. The overall watermark payload pL Wy for an error 
25 free detection, is then given as a combination of r S jgn and pL: 



(8) 
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The maximum information (I max \ in number of bits, that can be carried by a 
watermark sequence of length L w is thus given by: 

/max = l°g2(4 bits (9) 

5 Fig. 1 1 shows a block diagram of a watermark detector (200, 300, 400). The 

detector consists of three major stages: (a) the watermark symbol extraction stage (200), (b) 
the buffering and interpolation stage (300), and (c) the correlation and decision stage (400). 

In the symbol extraction stage (200), the received watermarked signal y *[n] is 
processed to generate multiple (JV&) estimates of the watermarked sequence. These estimates 
10 of the watermark sequence are required to resolve a time offset that may exist between the 
embedder and the detector, so that the watermark detector can synchronize to the watermark 
sequence inserted in the host signal. 

In the buffering and interpolation stage (300), these estimates are de- 
multiplexed into N b separate buffers, and an interpolation is applied to each buffer to resolve 
15 possible timescale modifications that may have occurred e.g. a drift in sampling (clock) 
frequency may have resulted in a stretch or shrink in the time domain signal (i.e. the 
watermark may have been stretched or shrunk). 

In the correlation and decision stage (400), the content of each buffer is 
correlated with the reference watermark and the maximum correlation peaks are compared 
20 against a threshold to determine the likelihood of whether the watermark is indeed embedded 
within the received signal y '[n]. 

In order to maximize the accuracy of the watermark detection, the watermark 
detection process is typically carried out over a length of received signal y '[n] that is 3 to 4 
times that of the watermark sequence length. Thus each watermark symbol to be detected can 
25 be constructed by taking the average of several estimates of said symbol. This averaging 

process is referred to as smoothing, and the number of times the averaging is done is referred 
to as the smoothing factor s/. Thus the detection window length Ld is the length of the audio 
segment (in number of samples) over which a watermark detection truth-value is reported. 
Consequently, L d =sjL w T Sj where T s is the symbol period and L w the number of symbols 
30 within the watermark sequence. Typically, the length {Lb) of each buffer 320 within the 
buffering and interpolation stage is L b =s f L w . 
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In the watermark symbol extraction stage 200 shown in Fig. 1 1, the incoming 



watermark signal y'[n] is input to the signal conditioning filter H b (210). This filter 210 is 
typically a band pass filter and has the same behavior as the corresponding filter (H* 20) in 
the watermark embedder 10. The output of the filter H b \sy' b [n], and assuming linearity 
5 within the transmission medium, it follows from equations (1) and (3): 



embedder and the detector is implicitly ignored. For ease of explanation of the general 
watermarking scheme principles, from now on, it is assumed that there is perfect 

10 synchronism between the embedder and the detector (i.e. no offset). It should be noted 

however that if there is not perfect synchronism between the embedder and the detector, then 
the deviation can be compensated for within the buffering and interpolation stage 300 
utilizing techniques known to the skilled person e.g. iteratively searching through alternative 
shifts in scale and offset until a best match is achieved. 

15 Note that when no filter is used in the embedder (i.e., when H=l) then Hb in 

the detector can also be omitted, or it can still be included to improve the detection 
performance. If Hb is omitted, then y b in equation (10) is replaced with y. The rest of the 
processing is the same. 

Assuming that the audio signal is divided into frames of length T S9 and that y'b>m[n] is the n- 
20 th sample of the m-th filtered frame signal, the energy E[m] corresponding to the /w-th frame 
is thus: 



where SfnJ is the same window shaping function used in the watermark conditioning circuit 
of Fig. 10. A person skilled in the art will appreciate that equation 1 1 represents a matched 
25 filter receiver, and is the optimum receiver when the symbol period is perfectly synchronized. 
Not withstanding this fact, from now on, we set S[n]=l in order to simplify subsequent 
explanations. 



y\ ["] ~ yb M = (1 + ow{n])x b [n] 



(10) 



Note that in the above expression, the possible time offset between the 




01) 



30 
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Combining this with equation 10, it follows that: 



(12) 



n~0 n=0 



5 



where w e fmj is the m-th extracted watermark symbol and contains N b time-multiplexed 
estimates of the embedded watermark sequences. Solving for w e [m] in equation 12 and 
ignoring higher order terms of a, gives the following approximation: 




\ 



(13) 



J 



In the watermark extraction stage 200 shown in Fig. 1 1, the output y \[n] of 



the filter H b is provided as an input to a frame divider 220, which divides the audio signal 
into frames of length T 5 i.e. into y ' b . m [n] t with the energy calculating unit 230 then being used 

10 to calculate the energy corresponding to each of the framed signals as per equation (1 1). The 
output of this energy calculation unit 230 is then provided as an input to the whitening stage 
H w (240) which performs the function shown in equation 13 so as to provide an output w e [m] . 

It will be realized that the denominator of equation 13 contains a term that 
requires knowledge of the host (original) signal x. As the signal x is not available to the 

15 detector, it means that in order to calculate w e [m] then the denominator of equation 13 must 
be estimated. 

Below is described how such an estimation can be achieved for the bi-phase 
window shaping function, but it will equally be appreciated that the teaching could be 
extended to other window shaping functions. 
20 It will be seen by examination of the bi-phase window function shown in Fig. 

2, that when the audio envelope is modulated with such a window function, the first and the 
second halves of the frame are scaled in opposite directions. In the detector, this property is 
utilized to estimate the envelope energy of the host signal x. 



25 halves. The energy functions corresponding to the first and second half frames are hence 
given by 



Consequently, within the detector, the audio frame is first sub-divided into two 



£i[*]= S \y\ m [n)\ 



(14) 
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and 

B 2 lm]= T ^\y\ m [nf (15) 
«=r,/2 

respectively. As the envelope of the original audio is modulated in opposite directions within 
the two sub-frames, the original audio envelope can be approximated as the mean of Ei[m] 
5 and E 2 [m]. 

Further, the instantaneous modulation value can be taken as the difference 
between these two functions. Thus, for the bi-phase window function, the watermark w e [m] 
can be approximated by: 



10 



. 1 ( E x [m]-E 2 [m] } 

wJm] « 1 

2a{E l [m] + E 2 [m] J 



(16) 



Consequently, the whitening filter//*, 240 for a bi-phase window shaping 
function can be realized as shown in Fig. 10. Inputs 242 and 243 respectively receive the 
energy functions of the first and second halve frames EjfmJ and E2[m]. Each energy function 
is then split up into two, and provided to adders 245 and 246 which respectively calculate 

15 E/fmJ - E2fmJ 9 and E/fmJ + E 2 [mJ. Both of these calculated functions are then passed to the 
calculating unit 248 which divides the value from adder 245 by the value from 246 so as to 
calculate an estimate for the watermark w e [m], in accordance with equation 16. 

This output w e fmj is then passed to the buffering and interpolation stage 300, 
where the signal is de-multiplexed by the de-multiplexer 310, buffered in buffers 320 of 

20 length Lb so as to resolve any lack of synchronism between the embedder and the detector 
and interpolated within the interpolation unit 330 so as to compensate for a possible time 
scale modification between the embedder and the detector. Such compensation can utilize 
known techniques, and hence is not described in any more detail within this specification. 

As shown in Fig. 11, outputs (w DI , w D 2>— wdm) from the buffering stage are 

25 passed to the interpolation stage and, after interpolation, the outputs (w IJf w I2f ... w rN t) of this 
stage, which correspond to the different estimates of the correctly re-scaled signal, are passed 
to the correlation and decision stage. If it is believed that no time scaling compensation is 
required, the values (wp/, wo2, ... WDNtt) can be passed directly to the correlation and decision 
stage 400 i.e. the interpolation stage 330 can be omitted from the apparatus. 
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The correlator 410 calculates the correlation of each estimate w IJf j=l t ... t Nb 
with respect to the reference watermark sequence w c [k] Each respective correlation output 
corresponding to each estimate is then applied to the maximum detection unit 420 which 
determines which two estimates provided the maximum correlation peak values, and these 
5 estimates are chosen as the ones that best fit the circularly shifted versions w d i and w d2 of the 
reference watermark, and the correlation values for these estimate sequences are passed to the 
threshold detector and payload extractor unit 430. 

If the interpolation stage is omitted, alternatively the correlator 410 calculates 
the correlation of each estimate w DJ J=l, ...,Nb with the reference watermark sequence w s [k] 
10 and the results are passed on for subsequent processing to the units 420 and 430 as outlined 
in the above paragraph. 

The payload extractor unit 430 may be utilized to extract the payload (e.g. 
information content) from the detected watermark signal. Once the unit has estimated the two 
correlation peaks cLi and cL 2 that exceed the detection threshold, the distance pL between 
15 the peaks (as defined by equation (6)) is measured. Next, the signs pi and p2 of the 

correlation peaks are determined, and hence r sign calculated from equation (7). The overall 
watermark payload may then be calculated using equation (8). 

For instance, it can be seen in Fig. 13 that pL is the relative distance between 
the two peaks. Both peaks are positive i.e. pi = +1, and p2 = +1. From equation (7), r S jgn = 3. 
20 Consequently, the payload pLw = < 3, pL>. 

The reference watermark sequence w s used within the detector corresponds to 
(a possibly circularly shifted version of) the original watermark sequence applied to the host 
signal. For instance, if the watermark signal was calculated using a random number generator 
with seed S within the embedder, then equally the detector can calculate the same random 
25 number sequence using the same random number generation algorithm and the same initial 
seed so as to determine the watermark signal. Alternatively, the watermark signal originally 
applied in the embedder and utilized by the detector as a reference could simply be any 
predetermined sequence. 

Fig. 13 shows a typical shape of a correlation function as output from the 
30 correlator 410. The horizontal scale shows the correlation delay (in terms of the sequence 
bins). The vertical scale on the left-hand side (referred to as the confidence level cL) 
represents the value of the correlation peak normalized with respect to the standard deviation 
of the typically normally distributed correlation function. 
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As can be seen, the typical correlation is relatively flat with respect to cL, and 
centered about cL = 0. However, the function contains two peaks, which are separated by pL 
(see equation 6) and extend upwards to cL values that are above the detection threshold when 
a watermark is present. 

5 A horizontal line (shown in the Fig. as being set at cL = 8.7)represents the 

detection threshold. The detection threshold value controls the false alarm rate. 

Two kinds of false alarms exist: The false positive rate, defined as the :u. % 
probability of detecting a watermark in non watermarked items, and the false negative rate, 
which is defined as the probability of not detecting a watermark in watermarked items. 

10 Generally, the requirement of the false positive alarm is more stringent than that of the false 
negative. The right hand side scale on Fig. 1 1 illustrates the probability of a false positive 
alarm p. As can be seen, in the example shown, the probability of a false positive p=10' is 
equivalent to the threshold cL = 8.7, whilst p = Iff 83 is equivalent to cL = 20. 

After each detection interval, the detector determines whether the original 

1 5 watermark is present or whether it is not present, and on this basis output a "y es " or a "no" 
decision. If desired, to improve this decision making process, a number of detection windows 
may be considered. In such an instance, the false positive probability is a combination of the 
individual probabilities for each detection window considered, dependent upon the desired 
criteria. For instance, it could be determined that if the correlation function has two peaks 

20 above a threshold of cL = 7 on any two out of three detection intervals, then the watermark is 
deemed to be present. Obviously, such detection criteria can be altered depending upon the 
desired use of the watermark signal and to take into account factors such as the original 
quality of the host signal and how badly the signal is likely to be corrupted during normal 
transmission. 

25 It will be appreciated by the skilled person that various implementations not 

specifically described would be understood as falling within the scope of the present 
invention. 

For instance, whilst the implementation of a particular bi-phase window 
shaping function has been described, and in particular a bi-phase window shaping function in 
30 which each lobe is a Hanning function, it will be appreciated that the present invention is 
applicable to any window shaping function falling within the scope of the appended claims. 
The observed reduction in the DC component of the frequency spectrum has been determined 
to be related to having a window shaping function in which the integral over the function is 
zero i.e. the total positive area is equal to the total negative area. Use of such a function 
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reduces the DC component of the frequency spectrum irrespective of the watermark 
sequence. As useful information is not carried within the DC component, but only within the 
non DC components of the signal, any reduction in the DC component is desirable. 

Fig. 14 shows an example of an alternative window shaping function that 
would still fall within the scope of the present invention. The function has four lobes. The 
lobes between adjacent zero-crossing points are Harming window functions. It will be 
appreciated that such window shaping functions can be symmetric or anti symmetric. 

Whilst only the functionality of the embedding and detecting apparatus has 
been described, it will be appreciated that the apparatus could be realized as a digital circuit, 
an analog circuit, a computer program, or a combination thereof 

Equally, whilst the above embodiment has been described with reference to an 
audio signal, it will be appreciated that the present invention can be applied to other types of 
signal, for instance video and data signals. 

Within the specification it will be appreciated that the word "comprising" does 
not exclude other elements or steps, that "a" or "and" does exclude a plurality, and that a 
single processor or other unit may fulfil the functions of several means recited in the claims. 
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CLAIMS: 



1 . A method of generating a watermark signal for embedding in a multimedia 
host signal, the method comprising the steps of: taking a first sequence of values; applying a 
window shaping function to said sequence of values so as to form a smoothly varying signal 
suitable for embedding in the host signal; wherein the integral over the window shaping 

5 function is zero. 

2. A method as claimed in claim 1 , wherein the window shaping function has an 
anti-symmetric temporal behavior. 

10 3. A method as claimed in claim 1, wherein the window shaping function has a 

bi-phase behavior. 

4. A method as claimed in claim 3, wherein the bi-phase window comprises at 
least two Harming windows of opposite polarities. 

15 

5. A method as claimed in claim 1, wherein the frequency spectrum of the 
smoothly varying signal has a DC component less than a component of any non-DC peak 
within the frequency spectrum. 

20 6. A method as claimed in claim 1, wherein each value of the first sequence is 

represented by a pulse train of width T s so as to form a rectangular wave signal, the window 
shaping function also being of width T s . 

7. A method as claimed in claim 1, wherein said first sequence of values is 

25 convolved with the window shaping function so as to form said smoothly varying signal. 



8. A method as claimed in claim 1 , the method further comprising the step of 

embedding said smoothly varying signal into the host signal. 
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9. An apparatus arranged to generate a watermark signal suitable for embedding 
in a host multimedia signal, the apparatus comprising: a) a signal generator arranged to 
generate a watermark signal by taking a first sequence of values; and b) processing means 
arranged to apply a window shaping function to said sequence of values so as to form a 

5 smoothly varying signal suitable for embedding in a host signal; wherein the integral over the 
window shaping function is zero. 

10. An apparatus as claimed in claim 9, wherein the apparatus further comprises a 
watermark embedding apparatus that embeds said smoothly varying signal into the host 

10 signal. 

11. A multimedia signal comprising a watermark, wherein the original multimedia 
signal has been watermarked by a smoothly varying signal formed by applying a window 
shaping function to a sequence of values, the integral over the window shaping function 

15 being zero. 

12. A signal as claimed in claim 1 1 , wherein the temporal envelope of the original 
signal has been modified by the watermark. 

20 13. A method of detecting a watermark signal embedded in a multimedia signal, 

the method comprising the steps of: 

(a) receiving a multimedia signal that may potentially be watermarked by a 
watermark signal modifying the host multimedia signal; 

(b) extracting an estimate of the watermark from said received signal by assuming 
25 that the watermark comprises a sequence of values to which a window shaping function has 

been applied, the integral over the window shaping function being zero; and 

(c) processing the estimate of the watermark with a referenced version of the 
watermark so as to determine whether the received signal is watermarked. 

30 14. A method as claimed in claim 1 3, the method further comprising the step of 

applying a window shaping function to said received signal, the integral over the window 
shaping function being zero. 
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15. A method as claimed in claiml3, wherein the watermark signal has a payload, 
and the method further comprises the step of determining the payload of the watermark. 

16. A watermark detector apparatus arranged to detect whether a watermark signal 
5 is embedded within a multimedia signal, the watermark detector comprising: 

(a) a receiver arranged to receive a multimedia signal that may potentially be 
watermarked by a watermark signal modifying the host multimedia signal; 

(b) an extractor arranged to extract an estimate of the watermark from said 
received signal by assuming that the watermark comprises a sequence of values to which a 

10 window shaping function has been applied, the integral over the window shaping function 
being zero; and 

(c) a processor arranged to process the estimate of the watermark with a 
referenced version of the watermark so as to determine whether the received signal is 
watermarked. 



17. An apparatus as claimed in claim 16, wherein the apparatus further comprises 

a unit arranged to apply a window shaping function to the said received signal, wherein the 
integral over the window shaping function is zero. 
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